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(57)Abstract: 

PROBLEM TO BE SOLVED: To listen to speech information reception side 
without any wait tinge even through a low-speed transmission line and to listen 
to speech information of high quality in a short wait time even when the same 
speech information is listened again to with high quality. 
SOLUTION: A transmission part divides the encoding output obtained by 
encoding a speech input signal by a scalable encoder I into outline data of a low 
bit rate that C21 1 1 be transmitted in real time and detailed data for reproducing 
the speech signal with high quality by being combined with the outline data. A 
data transmission part 5 transmits the outline data together prior to the detailed 
data and then transmits the detailed data together thereafter. A reception part 
sequentially decodes the received outline data without waiting for the detailed 
data to be received and reproduces the speech signal in real time. Consequently, 
light listening becomes possible. The reception part once the outline data and 
detailed data are both transmitted puts the both together to reproduce the 



speech signal with high quality. 
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* NOTICES * 

JPO and NCIPI are not responsible for any 
damages caused by the use of this translation. 

IThis document has been translated by computer. So the translation may not 



reflect the original precisely. 

2.**** shows the word which can not be translated. 

3.ln the drawings, any words are not translated. 

CLAIMS 
[Claim(s)] 

[Claim 1] In the voice coding transmission system which reproduces said sound 
signal from encoding a sound signal in the transmitting section, transmitting 
through a transmission line, and receiving and decoding in a receive section said 
transmitting section For the coding output which encoded and acquired said 
sound signal, said sound signal The serially refreshable outline data of a low bit 
rate, Said sound signal is divided into the detail data for reproducing for high 
quality combining this outline data. It is what transmits said outline data 
collectively in advance of said detail data, and transmits said detail data 
collectively after that. Said receive section The voice coding transmission 
system characterized by being what compounds both and reproduces said 
sound signal for high quality if sequential decoding of said received outline data 
is carried out without waiting for reception of said detail data, said sound signal is 
reproduced serially and both said outline data and detail data are transmitted. 
[Claim 2] Said transmitting section is a voice coding transmission system 



according to claim 1 characterized by being what controls the bit rate of said 
outline data according to the situation of said transmission line. 
[Claim 3] m bits (m<n) of high orders of the n bits (n is two or more integers) 
PCM (Pulse Code Modulation) data obtained by said transmitting section 
carrying out analog-to-digital conversion of said sound signal Said outline data, It 
is what uses a low order n-m bit as said detail data. Said receive section The 
voice coding transmission system according to claim 1 or 2 characterized by 
being what reproduces said sound signal serially from m bits of high orders of 
said PCM data, and reproduces said sound signal for high quality from m bits of 
high orders of said PCM data, and the complex data of a low order n-m bit. 
[Claim 4] It is the voice coding transmission system according to claim 1 or 2 
characterized by being what said receive section reproduces said sound signal 
serially from said monophonic signal, and reproduces stereo voice from said 
monophonic signal and a differential signal by said transmitting section using the 
differential signal of the sound signal of said outline data and said multiple 
channel as said detail data for the monophonic sound signal adding the sound 
signal of the multiple channel for obtaining stereo voice. 
[Claim 5] It is the voice coding transmission system according to claim 1 or 2 
characterized by being what said receive section reproduces said sound signal 
serially from the low-pass component of said sound signal, and reproduces said 



sound signal in high quality from the low-pass component and high-frequency 
component of said sound signal by said transmitting section using the 
high-frequency component of said outline data and said sound signal as said 
detail data for the low-pass component of a sound signal. 
[Claim 6] Said transmitting section has the 1st and 2nd sign books, and optimal 
vector selection is performed from the 1st sign book to the target vector based 
on said sound signal. Next, two-step vector quantization processing which 
chooses from the 2nd sign book the subvector which approaches a target vector 
most combining the vector is performed. The index of the vector chosen from 
said 1st sign book Said outline data, It is what uses as said detail data the index 
of the vector chosen from said 2nd sign book. Said receive section Said sound 
signal is serially reproduced from the index of the vector chosen from said 1st 
sign book. The voice coding transmission system according to claim 1 or 2 
characterized by being what reproduces said sound signal in high quality from 
the index of the vector chosen from said 1st and 2nd sign books. 
[Claim 7] Said transmitting section is claim 1 characterized by being what waits 
for the transmission demand of the detail data sent from said receive section, 
and transmits said detail data to said receive section thru/or the voice coding 
transmission system of six given in any 1 term. 



DETAILED DESCRIPTION 



[Detailed Description of the Invention] 
[0001] 

[Field of the Invention] This invention relates to a suitable voice coding 
transmission systenr) to perform especially real-time transmission of speech 
information about the voice coding transmission system which encodes and 
transmits a sound signal. 
[0002] 

[Description of the Prior Art] When transmitting speech information through a 
communication line, unless all speech information is transmitted conventionally, 
playback of speech Information is not performed. For this reason, in transmitting 
speech information to real time and reproducing, it becomes important to choose 
the optimal transmission bit rate, i.e., coding compressibility, in consideration of 
a communication band. For example, when it desires a certain amount of 
playback quality, coding compressibility can seldom be raised, but by the time all 
speech information is transmitted, the latency time will occur. What is necessary 
is to raise coding compressibility and just to reduce playback quality to demand 
of wanting to try listening lightly, even if it lowers some playback quality. 



[0003] Conventionally, the scalable voice coding method which can choose the 
playback quality and coding compressibility at the time of decode as arbitration 
is proposed for such the object (for example, "coding of musical sound and voice 
with a scalable layered structure" God Akio, Miki **: the Acoustical Society of 
Japan lecture collected works, H7.9 voice B3-1-5, pp 277-278). Using three 
hierarchies* coding method, on the 1st hierarchy, this method encodes the 
narrow-band signal which carried out the down sampling of the input signal, 
takes the difference of the playback sound from the input signal which extended 
the band rather than the lower layer to a lower layer, and encodes this by other 
high order hierarchies, such a layered structure - the case (when there are no 
allowances in a communication band) of a low bit rate ~ the information only on 
a -lower layer ~ using - coding of low quality - performing ~ the case (when 
allowances are in a communication band) of a high bit rate - the information on 
the upper layer - using ~ a playback sound - a broadband ~ and it is quality 
and reproduces. 
[0004] 

[Problem(s) to be Solved by the Invention] However, in the conventional voice 
coding transmission system mentioned above, as a result of trying listening 
speech information lightly on real time by the receiving side, in desiring 
transmission of more quality speech information, it is necessary to retransmit the 



bit stream of a high bit rate from the beginning, and there is a problem that the 
latency time in that case becomes long, again. 

[0005] This invention was made in view of such a trouble, even if it is a low 
speed transmission line, it can try listening speech information without the 
latency time by the receiving side, and it aims at offering the voice coding 
transmission system which can hear the speech information of high quality by 
little latency time to hear the same speech information again for high quality as a 
result of an audition. 
[0006] 

[Means for Solving the Problem] In the voice coding transmission system which 
reproduces said sound signal from the voice coding transmission system 
concerning this invention encoding a sound signal in the transmitting section, 
transmitting it through a transmission line, and receiving and decoding in a 
receive section Said sound signal for the coding output said whose transmitting 
section encoded and acquired said sound signal The serially refreshable outline 
data of a low bit rate, Said sound signal is divided into the detail data for 
reproducing for high quality combining this outline data. It is what transmits said 
outline data collectively in advance of said detail data, and transmits said detail 
data collectively after that. If said receive section does sequential decoding of 
said received outline data, without waiting for reception of said detail data, and 



reproduces said sound signal serially and both said outline data and detail data 
are transmitted, it will be characterized by being what compounds both and 
reproduces said sound signal for high quality. 

[0007] If the transmitting section transmits the outline data of a refreshable low 
bit rate serially, since a receive section will reproduce this outline data serially 
according to this invention, without waiting for reception of detail data, it can try 
listening the outline of music information without the latency time lightly. 
Consequently, what is necessary is to wait for transmission of detail data and 
just to reproduce speech information, when the user of a receiving side wants to 
hear the still more nearly quality and same speech information, since detail data 
are compounded with outline data and reproduced, compared with the case 
where all speech information is again transmitted like before, the latency time is 
boiled markedly and mitigated. Moreover, when expectation of the user of a 
receiving side is not answered as a result of the audition of the received outline 
data, reception of future data can be stopped and useless transmission of the 
data based on this can be prevented. 

[0008] In addition, what is necessary is just to adjust the bit rate of outline data 
according to the situation of a transmission line, in transmitting speech 
information using a network where a communication band is changed every 
moment like the Internet. In this case, what is necessary is just to insert suitably 



the information on a data rate, or the information on that change in the bit stream 
to transmit. 

[0009] As outline data, data of m bits of high orders of n-bit PCIVI data, the 
addition data of the right-and-left channel in stereo voice, the low-pass 
component of a sound signal, the vector index of the 1st step in two-step vector 
quantization, etc. can be used, for example, moreover, the difference of a 
right-and-left channel [ in / corresponding to these as detail data / the data of the 
low order n-m bit of the above-mentioned PCM data, and the above-mentioned 
stereo voice ] - data, the high-frequency component of a sound signal, the 
vector index of the 2nd step in two-step vector quantization, etc. can be used, 
respectively, thus, since detail data constitute a part of speech information, 
compared with the total amount of information of the speech information in the 
case of resending in order to acquire the same quality, it is markedly alike, and 
the amount of information of itself has it, consequently they can also lessen the 
latency time. [ little ] 

[0010] Moreover, if the transmitting section waits for the detail data transfer 
demand sent from a receive section and transmits detail data to a receive 
section, transmission of useless data can be prevented still more effectively. 
[0011] 

[Embodiment of the Invention] Hereafter, the gestalt of desirable implementation 



of this invention is explained with reference to a drawing. Drawing 1 is the block 
diagram showing the configuration of the transmitting section in the voice coding 
transmission system concerning the example of this invention. In addition, as 
this transmitting section, the method which transmits the outline data of a fixed 
low-speed bit rate first, and the method which adjusts the bit rate of outline data 
according to a network situation can be considered regardless of a network 
situation. Then, the configuration of the transmitting section is hereafter 
explained about the two above-mentioned kinds of methods, respectively. 
[0012] (1) When the bit rate of outline data is immobilization, a voice input signal 
is divided into the outline data of a fixed bit rate, and the detail data for 
complementing this outline data and enabling playback of high quality based on 
the bit rate information directed beforehand while being inputted into the 
scalable encoder 1 and encoding here based on a predetermined coding 
method. Outline data are supplied to a multiplexer 2 with additional information, 
such as a header and a boundary identifier. Once detail data are memorized by 
the store 3, reading appearance of them is carried out under control of the 
rearrangement section 4, and they are supplied to a multiplexer 2. A multiplexer 
2 carries out sequential supply of the supplied data in the data transmitting 
section 5 at the sequence of a header, outline data, a boundary identifier, and 
detail data. The data transmitting section 5 transmits the bit stream supplied 



from the multiplexer 2 to a receive section through a transmission line. The bit 
rate control section 6 determines the bit rate of outline data according to a 
directions input, and gives bit rate information to the scalable encoder 1. In 
addition, even if the network which transmits is a low speed, a bit rate is set up 
by the transmitting side so that it may become the amount of information in 
which real-time transmission is possible. 

[0013] The example of a format of the bit stream assembled by the multiplexer 2 
of this transmitting section is shown in drawing 2 (a). A bit stream is assembled 
in order of a header, outline data, a boundary identifier, and detail data. 
[0014] (2) When the network situation Monitoring Department 7 always 
supervises a network situation through the data transmitting section 5 in this 
case when the bit rate of outline data is adjustable, and a communication band is 
changed, give directions information to the bit rate control section 6, and adjust 
the bit rate of outline data. As the adjustment approach of a bit rate, the coding 
number of bits can be dropped or approaches, such as thinning out data 
selectively, can be considered. In this case, the bit rate of outline data and the 
detail data which make a pair will be created in a form which absorbs change of 
the bit rate of outline data. 

[0015] A format of the bit stream assembled by the multiplexer 2 in case a bit 
rate is adjustable becomes like drawing 2 (b). That is, the information which 



shows that a bit rate changes just before a bit rate changes is inserted in the 
outline data following a header. Thereby, it becomes possible to recognize the 
bit rate of outline data in a receive section^ 

[0016] In addition, detail data are further divided into some, they are rearranged 
into order with a high significance, reading appearance may be made to be 
carried out. and you may make it rearrange a frame so that a part with a high 
significance in music may be transmitted first. As shown in this drawing (b), the 
part (this example frame numbers 16-20) of the so-called "rust" I want a data 
origination person to ask to a listener for high quality is arranged to the beginning 
of detail data, so that it may be shown in the case of music data (a) (for example, 
drawing 3 ). Thereby, even when download of detail data is stopped on the way, 
about the part I want an implementer to hear, it can be heard to a quality 
playback sound. Rearrangement of such detail data is performed in the 
rearrangement section 4. 

[0017] Drawing 4 is the block diagram showing the configuration of a receive 
section. Once it is received in the data receive section 11 and the bit stream 
transmitted through the network is stored in a store 12, it is serially supplied to a 
decoder 13. A decoder 13 recognizes data after a header is detected until a 
boundary identifier is detected to be outline data, and starts decoding serially. 
Although decoding on real time is realized and playback quality falls off a little by 



this, sufficient playback sound to try listening lightly is obtained on real time. 
[0018] Moreover, even if it lowers a bit rate considerably depending on a network 
congestion situation, transmission of real time may become impossible. In this 
case, the network situation Monitoring Department 14 supervises a network 
situation, and transmits that monitor result to the decoding control section 15. A 
decoder 15 is controlled serially to start serial decoding with the decoding control 
section 15 continuous while setting up the latency time like the waiting for 1 
minute, 2-minute waiting, and corresponding to a network situation and being 
made not to decode only by receiving data between this latency time serially, 
after the latency time passes. Thereby, decoding almost near real time without a 
sound piece is attained. 

[0019] Although received following this outline data, detail data enable it to 
choose whether a listener wishes transmission of the speech information of high 
quality further, wait to transmit this selection demand to the transmitting section 
from a receive section, and you may make it transmit detail data by the audition 
result in a receive section. 

[0020] When transmission of detail data is also completed and all detail data are 
stored in a store 12, the outline data with which the merge section 16 is already 
transmitted, and the detail data which transmission ended are compounded. 
When detail data are further divided into plurality, outline data and two or more 



detail data will be compounded in the merge section 16. The compounded data 
are decoded by the decoder 17. Thereby, a sound signal is reproducible for high 
quality. 

[0021] Next, the still more concrete example of the scalable encoder 1 is 
explained. Drawing 5 is drawing showing the example of a configuration of the 
scalable encoder 1 with which PCM data were divided into the high order bit and 
the lower bit, the high order bit was used as outline data, and it used the lower bit 
as detail data. Analog-to-digital conversion of the voice input signal is carried out 
with a predetermined sampling frequency with AID converter 21, for example, it 
serves as 1 6-bit PCM data. This PCM data is divided into outline data of 8 bits of 
high orders, and detail data of 8 bits of low order in the bit division section 22. 
The additional information generation section 23 generates additional 
information, such as a header and a boundary identifier, generates and outputs 
a header at the head of a voice input signal, and generates and outputs a 
boundary identifier to the end of a voice input signal. 

[0022] When a bit rate is fixed, as shown in drawing 6 (a), a bit stream It is 
arranged in order of data of 8 bits of low order of a header, data of 8 bits of high 
orders of PCM data, a boundary identifier, and PCM data, and is transmitted. In 
a receive section Carry out D / A conversion of the PCM data of 8 bits of high 
orders, and voice is reproduced on real time. If PCM data of 8 bits of low order 



are also transmitted, the voice of higti quality will be reproduced by 
compounding and carrying out D / A conversion of the 16-bit PCM data in 
corresponding 8 bits of high orders and 8 bits of low order of a frame. Since PCM 
data of 8 bits of high orders as outline data can reduce a bit rate to 1/2 compared 
with the case where it transmits in a full bit, voice transmission on real time is 
attained also in a low-speed network. Moreover, the transmission latency time of 
PCM data of 8 bits of low order as detail data can also be shortened to one half 
compared with the case where the data of a full bit are resent. 
[0023] In changing a bit rate according to a network situation, according to bit 
rate information, the bit division section 22 changes the number of bits of a high 
order, and the low-ranking number of bits, and the additional information 
generation section 23 outputs the information which shows modification of a bit 
rate. Supposing PCM data are 16 bits, as shown, for example in drawing 6 (b), it 
will fix to 8 bits of high orders, and the first outline data following a header will 
insert the data of "0" (with no bit rate modification), or "1" (a bit rate being subject 
to change) in the boundary of 8-bit data. And it is 00 as information which shows 
modification of a bit rate for 2 bits following it when "1" (a bit rate being subject to 
change) is inserted. -> Increment 01 in 1 bit -> Increment 10 in 2 bit -> 1-bit 
reduction 1 1 -> What is necessary is just to make it direct the number of bits to 
fluctuate like 2-bit reduction. 



[0024] Drawing 7 is the example of the scalable encoder 1 when one channel is 
used as outline data and it uses the remaining channels as detail data among 
the sound signals of many channels. The 1st and the sound signal of the 2nd 
channel are stereo signals of for example, a right-and-left channel, and the 3rd 
channel is for example, a super woofer signal. A/D conversion of the signal of 
each [ these ] channel is carried out with A/D converters 31. 32. and 33, 
respectively. The 1st and the digital data of the 2nd channel are added with an 
adder 34, and serve as a monophonic signal, and this monophonic signal is 
outputted as outline data. On the other hand, the 1st and the digital data of the 
2nd channel serve as a differential signal (1ch-2ch) with a subtracter 35. . And 
this differential signal and the signal of the 3rd channel are outputted as detail 
data. The additional information generation section 36 carries out the generation 
output of the header at the head of a monophonic signal, and carries out the 
generation output of the boundary identifier at the tail. Thereby, the bit stream 
generated serves as a header, data of (1ch+2ch), a boundary identifier, and 
(1ch-2ch) data that continue in order of the data of 3ch(es) like drawing 8 . 
[0025] Drawing 9 is the block diagram of the scalable encoder 1 at the time of 
applying this invention to MPEG(Moving Picture Experts Group)-Audio. Input 
voice is divided into the frequency band of 32 in the subband division section 41. 
and subsampling is carried out for every band, and it serves as data of 1 band 12 



sample extent. In the scaling section 42, it separates into the wave and scale 
factor which were normalized, and this data is supplied to the quantization 
section 43. On the other hand, in the FFT (Fast Fourier Transform) section 44, 
the fast Fourier transform of the input signal is carried out. Based on the 
called-for voice spectrum, and the wave for every band and scale factor which 
were called for in the scaling section 42, bit assignment according to the 
acoustic-^sense mental model 45 which also considered the masking effect is 
performed in the bit quota section 46. According to this bit assignment, the 
quantization section 43 quantizes the wave for every band, and a scale factor. 
Among these, the bit stream configuration section 47 outputs the data for a 
low-pass area part as outline data, and outputs the data for a high-pass area 
part as detail data. Based on bit rate information, the bit quota section 46 and the 
bit stream configuration section 47 determine what bit rate is assigned to a part 
for a low-pass area part. A format of the generated bit stream becomes a header, 
the data for a low-pass area part, a boundary identifier, and the thing with which 
the data for a high-pass area part were located in a line in order like drawing 10 
(a). Moreover, when a bit rate is made adjustable, as shown in this drawing (b), 
the information which shows change of a bit rate will be inserted in a part for the 
direct anterior part of change of the bit rate of the data for the low-pass area part 
following a header. 



[0026] Drawing 1 1 is the block diagram showing the configuration of the scalable 
encoder 1 at the time of applying this invention to multistage vector quantization. 
The data which carried out orthogonal transformation of a voice input signal or 
this by MDCT (Modified Discrete Cosine Transform) etc. are made into a target 
vector. In the 1st-step output vector decision section 51, optimal vector selection 
is performed from the 1st sign book 52 to this target vector. In the 2nd-step 
output vector decision section 53 The subvector which approaches a target 
vector most is chosen from the 2nd sign book 54 based on the distorted count 
result in the distorted count section 55 in combination with the vector chosen in 
the preceding paragraph. The Maine index chosen from the 1st sign book 52 
and the subindex chosen from the 2nd sign book 54 are compounded based on 
bit rate information in the bit stream configuration section 56, and a bit stream is 
generated. In this case, since playback of the voice of a certain amount of [ the 
Maine index ] quality is possible, outline data and a subindex can be used for the 
Maine index as detail data. 

[0027] When a bit rate is set up fixed, a bit stream is transmitted in order of the 
subindex as header information, the Maine index as outline data, a boundary 
identifier, and detail data, as shown in drawing 12 . What is necessary is to 
operate the Maine index on a curtailed schedule suitably, or to also add a 
subindex to the Maine index and just to consider as outline data, in changing a 



bit rate according to a network situation. 
[0028] 

[Effect of the Invention] According to this invention, as stated above, the 
transmitting section transmits the outline data of a refreshable low bit rate 
serially, and since a receive section is reincarnated serially, without waiting for 
reception of detail data, this outline data When it can try listening the outline of 
music information without the latency time lightly and the user of a receiving side 
moreover wants to hear the still more nearly quality and same speech 
information That what is necessary is to wait for transmission of detail data and 
just to reproduce speech information, compared with the former, also boil the 
latency time in this case markedly, and it is mitigated. And when expectation of 
the user of a receiving side is not answered as a result of the audition of the 
received outline data, reception of future data can be stopped and the 
effectiveness that useless transmission of the data based on this can be 
prevented is done so. 



DESCRIPTION OF DRAWINGS 



[Brief Description of the Drawings] 



[Drawing 1] It is the block diagram of the transmitting section of the voice coding 
transmission system concerning one example of this invention. 
[Drawing 2] It is drawing showing a format of the bit stream transmitted from this 
transmitting section. 

[Drawing 3] It is drawing showing the example of rearrangement of the detail 
data in this bit stream. 

[Drawing 4] It is the block diagram of the receive section of a same sound voice 
coding transmission system. 

[Drawing 5] It is the block diagram showing the 1st example of the scalable 
encoder in this transmitting section. 

[Drawing 6] It is drawing showing a format of the bit stream generated by this 
encoder. 

[Drawing 7] It is the block diagram showing the 2nd example of the scalable 
encoder in this transmitting section. 

[Drawing 8] It is drawing showing a format of the bit stream generated by this 
encoder. 

[Drawing 9] It is the block diagram showing the 3rd example of the scalable 
encoder in this transmitting section. 

[Drawing 10] It is drawing showing a format of the bit stream generated by this 
encoder. 



[Drawing 11] It is the block diagram showing the 4th example of the scalable 
encoder in this transmitting section. 

[Drawing 12] It is drawing showing a format of the bit stream generated by this 
encoder. 

[Description of Notations] 

1 [ -- The rearrangement section, 5 / -- The data transmitting section, 6 / - 7 A bit 
rate control section, 14 / The network situation Monitoring Department, 11 / - 
A data receive section, 13 / - It is a decoder and 15 serially. / - A decoding 
control section, 16 / - The merge section, 17 / - Decoder. ] - A scalable 
encoder, 2 -- 3 A multiplexer, 12 - A store. 4 
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[0 0 0 7] L.(DmKxm. mmmm^'^m 

mc-^ffuMxni^^pmm^rc^^'^-^icii.. mmr 
-^(oB.mmox^pm<Dn^^n^iii^^\ mm 
r-^tt. 'mT—^'t-k^t^nxmtm(ox\ u 
5 ic^x(D^pmmmBmt^^-^Kit<. 

fc^^ttj. mi<DT—^(D^im'¥tt^iitt^x 
ctuc^^T—SKommjiBmmtxt^o 

[0 0 0 8] *43. -fyif-^-y h(Oiolzmmmif 
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2 )!)>?.^$nfcl: 7 b X b 'J -A^e)MiSS 
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U #)!lDlf^afiEg|5 2 3a. e7fb-KD^M*S^t 
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•3. 4fi!c?n5k'7hXbU-Att. E8©J:3(c. 
-j^. ( 1 ch+ 2 ch) Or- ^ . mnUm^s ( 1 ch- 
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tSo 4fig^n/clf7 hXhU-A07;j— V7ha. 
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(OiioK. '^7:^ti!<ffi^S?gi5^©T-^©^^•y^^- 

[0 0 2 6] 0 1 1 a. V)]^mi-\tKL(ow^ 

10 ^m^Lfcm-^oyx^-yfJl ■ xy3-:5?i O^fig^ 
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